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ABSTRACT 


"  In  models  of  reliability  growth  in  stages,  it  is  usual  to  assume  that 
system  parameters  improve  monotonically  from  stage  to  stage,  following 
some  postulated  law  of  growth.  This  paper  explores  a  Bayesian  model 
where  such  improvement  only  occurs  on  the  average,  e.g. ,  a  case  when 
the  parameters  are  assumed  to  be  stochastically  ordered.  It  is  shown 
that  the  problem  can  be  recast  into  a  hierarchical  form  in  which  there 
are  strictly-ordered  hyperparameters  which  index  the  admissible  family 
of  ordered  distributions  for  the  parameters;  the  modelling  problem  is 
then  to  describe  an  appropriate  law  of  motion  over  the  hyperparameters 
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STOCHASTICALLY-ORDERED  PARAMETERS  IN  BAYESIAN  PREDICTION 


by 

William  S.  Jewell 


0.  INTRODUCTION 

Models  of  reliability  growth  have  received  increasing  attention  in 
recent  literature.  One  approach  is  to  assume  an  underlying  continuous 
improvement  in  system  parameters;  we  call  this  the  learning -curve  approach 
(Jewell  [2]).  A  second  model,  which  may  be  more  appropriate  under  certain 
circumstances,  is  growth  by  stages,  in  which  the  parameters  increase  (or 
decrease)  monotcmically  at  certain  fixed  points  in  time,  when  design 
improvements  are  made.  In  both  of  these  models,  an  important  problem 
is  the  prediction  of  the  ultimate  performance  of  the  system  after  all 
reliability  growth  has  occured  or  all  the  design  modifications  have  been 
effected;  in  practical  procurement  problems,  it  is  desirable  to  make 
these  predictions  using  as  little  test  data  as  possible. 

This  paper  explores  an  extension  of  the  growth  by  stages  model 
suggested  by  N.  Singpurwalla  [3]  in  which  the  parameters  improve  only 
stochastically ,  rather  than  absolutely. 
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[.  DETERMINISTICALLY-ORDERED  PARAMETERS 


Consider  the  usual  set-up,  in  which  random  observables  x^,x2> 
in  periods  1,2,  . ..,  t  are  governed  by  random  parameters  according  to 
some  likelihood  density  p(x^,X2»  •••,  xt  |  9t)  *  Given  a 

prior  parameter  density  p(9i»92’  0C)  »  and  observations  x  * 

(x2,X2,  ...,  xt)  ,  a  straightforward  application  of  Bayes'  law  calculates 
the  posterior  parameter  density  pO^.e^,  . ..,  0  |  x)  . 

In  most  applications,  0  is  assumed  sufficient  for  xt  ,  so  that 
the  likelihood  takes  the  simpler  form: 


(1-1)  p(x^>x2*  •••»  X£  I 


V 


t 

n  p,(x.  I  0J  ; 
i-1 


we  retain  explicit  dependence  upon  the  time  period  primarily  to  permit 
stages  of  different  duration,  but  not  usually  different  failure  laws  in 
each  interval. 

In  the  usual  growth-by-stages  model,  the  improvement  is  expressed 
in  terms  of  a  deterministic  ordering  of  the  parameters,  say: 


(1.2) 


91  i  62  i  •••  i  ^  . 


and  this  is  handled  in  an  obvious  way  through  the  definition  of  the 
parameter  prior  and  its  support.  A  usual  simplification  is  to  fix 
some  6‘q  ,  and  then  suppose  that  depends  only  upon  9  ^  ,  and  not 

upon  other  parameters  or  the  index  i  ,  so  that: 


(1.3)  p(01,02,  ....  et) 


n  p(0a  I  0t_.) 
i-l  1  11 


^60  -  ei  -  62  -  9t> 


Typically  a  prototype  parameter  density  g(u)  ,  0  <_  u  <_  1  ,  is  selected 


for  modelling  convenience,  giving  a  common  form  to  the  "shrinkage" 
of  the  parameters,  viz. 


(1.4) 


K*!  I  91-1>  - 


(i  ■  1,2,  • • • 9  t)  • 


The  actual  Bayesian  calculations  are  complicated,  but  present  no 
conceptual  difficulties;  Smith  [4]  gives  an  example  with  p(xt  |  0t) 
binomial,  and  g(‘)  uniform.  Of  course,  (1.2),  (1.3)  and  (1.4) 
represent  rather  strong  beliefs  about  the  underlying  growth  mechanism. 
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2.  STOCHASTICALLY-ORDERED  PARAMETERS 

N.  Singpurwalla  [3]  has  suggested  that  (1.2)  might  reasonably 
be  replaced  by  the  weaker  hypothesis  that 

(2.1)  ®l  ~  ~  ~  ®t  ‘ 

This  might  mean,  for  example,  that  while  the  failure  rate  tended 
to  decrease  from  stage  to  stage,  such  growth  was  by  no  means  certain 
in  a  given  realization.  We  now  modify  the  basic  model  to  handle  this 
assumption. 

(2.1)  implies  that  the  parameters  are  selected  from  some  family 
F  of  priors  which  are  stochastically  ordered  over  the  different  stages. 

Let  a  be  a  scalar  hyperparameter  which  indexes  the  members  of  this 
family.  Then  we  can  associate  a^ot^,  ...,  at  with  stages  1,2,  ...,  t  , 
and  arrange  that 

(2.2)  i  a2  -  ‘ -  at 

(or  an  increasing  version)  selects  an  appropriately  ordered  distribution 
for  each  parameter.  Specifically,  F-  is  a  family  of  conditional  prior 
densities  p(0  |  a)  ,  with  complementary  distribution  PC(9  |  a)  ,  such 
that,  for  every  value  of  9  and  every  i  <  j  (i  ,  j  =  1,2,  ...) 

(2.3)  Pc(9  |  c^)  >  Pc(9  |  a  )  ; 

this  can  be  visualized  as  in  Figure  1.  can  be  an  actual  hyperparameter 

of  the  (conditional)  prior,  or  it  can  be  an  abstract  index  that  selects 
one  of  an  admissible  member  of  ordered  priors.  The  key  point  is  to  arrange 
things  so  that  (2.2)  guarantees  (2,1). 


FIGURE  1 


ADMISSIBLE  FAMILY,  F  ,  OF  STOCHASTICALLY 
ORDERED  CONDITIONAL  PRIORS  ON  6 
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With  (2.1)  guaranteed,  what  can  we  say  about  the  selection  of 
the  hyperparameters?  In  a  Bayesian  model  we  must  now  express  our 
prior  beliefs  and  previous  experience  about  what  values  of  a^.c^,  •  oit 
might  occur  during  the  different  stages.  In  other  words,  we  consider  the 
hyperparameters  as  random  variables  with  a  given  hyperprior  density 
p(a^,a2»  . ..,  ac)  over  the  family  F  satisfying  (2.2). 

Effectively,  the  stochastic  ordering  has  introduced  a  hierarchical 
Bayesian  formulation  (see,  e.g.,  Jewell,  [1]),  in  which  we  again  have 
deterministic  ordering,  this  time  in  the  hyperparameters.  Note  also 
that  this  approach  avoids  the  "pseudo-Bayesian"  formulation  described 
by  Singpurwalla  [3]. 

For  convenience  in  the  sequel ,  we  assume  a  Markovian  hyperprior 
similar  to  (1.3),  so  that,  given  aQ  ,  and  a  family  of  (hyperprior) 
transition  densities  p(ai  |  >  we  have: 

t 

(2.4)  p(a1,a2,  . . . ,  at)  *  n  p(ai  |  a^)  (afl  1  ai  i  a2  i  ' 1  '  -  at'  • 

(<1q  could,  of  course,  have  an  initial  density  of  its  own.  But,  for 
simplicity,  we  omit  further  explicit  mention  of  “q) • 

In  summary,  we  have  the  following  model: 

(a)  Prior  beliefs  or  experience  specify: 

(i)  Oq  and  the  hyperprior  transition  densities  p(a  |  ^) 

with  deterministic  ordering  (2.2); 

(ii)  the  family  F  of  admissible  conditional  priors,  so  that, 
given  ,  9^  has  complementary  distribution  PC(0^  |  ad) 


i 


and  stochastic  ordering  (2.1); 


(b)  A  known  failure  law  governs  the  different  observational 
likelihoods  p.(x.  I  0.)  . 

Note  that  a.  is  sufficient  for  8.  which  is,  in  turn  sufficient 
l  i 

for  ,  so  that,  given  a  =  (a^,  at>  ,  the  problem  of  predicting 

0_  “  (®i »®2 ’  ®t)  and/or  x  =  (x^,X2,  ....  xfc)  decomposes  into 

several  separate  problems.  However,  the  usual  situation  is  that  we 
are  given  the  observations  x  ,  and  want  to  update  the  distributions 
of  the  unobserved  0^  and  £  ,  or  to  predict  future  observations 
xt+1,xt+2>  •••  •  Because  of  the  Markovian  dependence  of  the  , 
both  of  these  problems  require  extensive  applications  of  Bayes  ’  law. 


3.  MARGINAL  DENSITIES 

As  a  preliminary,  we  indicate  how  to  calculate  the  various  marginal 
densities.  For  the  parameters,  the  joint  marginal  is: 


(3.1)  p(e1,e2. 


t 

ji  p(e 
i=l 


»i)p(ai  ]  ajL_1)dai  . 


Perhaps  the  easiest  way  to  calculate  is  by  defining: 


(3.2)  p(91;a2)  =>  j  p(@2  |  ct^p^  |  a^p^  |  ct^dc^  , 


and  then  proceed  iteratively  to  find: 


(3.3) 


p(91,02,  ....  0±  ;  ai+1)  =  J*  p(01  !  cti)P(“i+1  I 


•  P(®]L> ®2*  ' " ’  ^i— l  ’ 

for  i  >  2,3,  ...  .  At  any  point  t  where  the  marginal  density  is 
desired. 


(3.4)  p(01,02. 


p(0 


r  2* 


t-i 


a  )d a 
t  t 


It  is  clear  that  the  j  J  cons^.-.tfe  x  s.  hast  rt 

which  is  not  Markovian  (as  in  (1.3)).  One  can  show,  however,  that  the 
nature  of  F  ,  expressed  in  (2.3),  implies  ordered  marginals: 


(3.5)  Pr  {0t  >_  0}  >_  Pr  >  9}  ,  (i  <  j)  (V  0) 


as  expected. 
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For  the  observables  {x^}  ,  the  intermediate  nature  of  the  {6.} 

t  1 

suggests  we  define  ,rbyipass"  conditional  densities  from  the  likelihood 
and  prior,  viz.. 


(3.6) 


Pi(xi 


a.) 

l 


ei>p(ei 


a.)de 


i 


for  i  =  1,2,  ...  .  The  joint  marginal  of  the  observations  is  then 
similar  to  (3.1): 


(3.7)  p(x1,x2. 


//•••/ i 


pi(xi 


ai)p(ai 


«i-l)d«i 


which  can  also  be  "bootstrapped"  as  in  (3.2),  (3.3).  Alternately,  if 
(3.1)  or  (3.4)  were  first  calculated. 


(3.8)  p(x1,x2,  ....  xt)  *  //-/  p(e1,02,  . . . ,  et)  n  pi(xi  |  e 


i>dei 


i 
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4.  UPDATING  HYPERPARAMETERS 

We  turn  now  to  the  calculation  of  the  inverse  probabilities. 

By  using  the  bypass  conditional  densities  of  (3.6),  we  find  that 
(given  aQ) : 

t 

(4.1)  p(alf  ....  a£  ;  x^x^  ....  xt)  =  n  Pi(^i  |  c^)  •  p(a±  |  a^) 

so  that  the  update  formula  for  the  hyperparameters  (i.e.,  the  "hyper- 
posterior-to-the-data"  density)  is: 


(4.2) 


p(a 


1* 


°t  1 


t 

n 

i=l 


pi(xi 


ai) 


P(a. 


Vl5 


p(x) 


p(x)  is  calculated  in  (3.7),  but  in  most  practical  calculations,  it  is 
treated  simply  as  a  normalization  factor.  Note  that  "later"  observables 
provide  information  about  "earlier"  hyperparameters  because  of  the 
Markovian  dependence. 
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5.  PREDICTING  HYPERPARAMETERS 

The  prediction  of  a  ^  from  x  is  most  easily  "bootstrapped"  in  a 
manner  similar  to  (3.2),  (3.3).  We  define: 


(5.1)  p(x1;a2)  »J*p1(x1  |  |  a^p^  |  a^dc^ 


and  then  proceed  iteratively  for  i  *  2,3,  ...  . 


(5.2) 


p(xlfx2,  ...,  xi  ;  cti+1)  -  j  Pt(xt  I  I 


p(x^,x2>  ...,  x^  ^  ;  a^)da^ 


At 


any  stage  t  ,  the  prediction  of  ot  is  a  simple  normalization,  viz. 


(5.3) 


P(0t+1  1  ^ 


P(X1,X2 . Xt  ;  °1t+l) 

P(x) 


The  iterative  calculations  (5.1),  (5.2)  provide  also  a  simple  formula  for 
updating  the  most  recent  hyperparameter: 


(5. A)  p(at  |  x) 


Pt(xt  I  <*t)  •  p(*1,x2,  ....  xt_1  ;  afc) 

p(x) 


6.  UPDATING  PARAMETERS 


It  does  not  seem  easy  to  provide  updating  for  the  parameters  alone, 
since  p(9^,  . ..,  9^  |  x)  requires  a  complex  integration  over  the 
Markovian  transition  probabilities.  If  all  the  marginals  (3.2),  (3.3) 
have  been  calculated  to  give  (3.4),  then,  of  course. 


(6.1)  p(e1,e2,  ,  et  |  x)  = 


n  p  (x  I  8  )p(6  ,0 . 9  ) 

i=l  c  c  *■ 


For  the  latest  parameter  only,  the  "bootstrap”  in  (5.2)  can  be  used  with 

fpt(*t  1  9 j)p(9 c  j  at)p(x1,x2 . xt-1  ;  ac)doc 

(6.2)  p(et  I  x)  .  2 - -  • 


All  data  must  be  used  to  update  0t  .  However,  if  we  also  know  , 
then  only  the  latest  observation  is  sufficient,  as  can  be  seen  from: 


,  pt(xt  I  Vp(0t  I  “t)  , 

(6.3)  p(9t  |  at  ,  x)  =  -  ■  ,  --j -  =  p(9t  |  ac  ,  x£)  . 


t  1  t' 
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7.  OTHER  PREDICTIONS 

In  fact,  the  hyperparameter  forecast  density  (5.3)  is  the  key  to 
all  other  predictions,  since,  given  x  ,  only  at+^  is  sufficient 
for  the  next  period,  since: 


(7.1) 


P(xt+1  ’  9t+l  ’  “t+1  I 


pt+l(xt+l  I  0t+l)p(9t+l  I  at+l)p(at+l  I  x)  5 


marginal  versions  follow  by  integration. 

For  stages  in  the  future,  this  generalizes  to 


p(x  ,  ,  0  ,  ,  ct  ,  j  x) 

t+u  t+u  t+u  1  — 


(7.2) 


pt+u^xt+u  ^  9t+U^P^9t+U  I  at+u^ 


•|p(U_1)(at+u  I  at+l)p(at+l  1  ^)dat+l 

for  u  =  2,3,  ...  ,  where  p^n\*  |  •)  is  the  usual  n-step  Markovian 
transition  probability. 


4 
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8.  MODEL  VARIATIONS 

The  model  described  in  (2.5)  is  actually  quite  general.  First 
of  all,  it  includes  the  deterministically-ordered  parameter  model  of 
Section  1  by  making  the  conditional  prior,  p(0  |  a)  ,  a  degenerate 
density — i.e.,  0fc  =  for  all  t  ;  the  transition  densities  of  (2.4) 
are  then  those  of  (1.3). 

If,  on  the  other  hand,  we  assume  a  time-invariant  hyperparameter 
a  »  ciq  =  -  ...  =  <*t  ,  with  initial  hyperprior  density  ir(a)  ,  then 

the  model  reduces  to  a  hypothesis  mixing  formulation ,  in  which  data 
from  successive  trials  is  helping  us  to  select  one  of  a  (usually 
finite)  number  of  priors  p (0 1  |  a)  .  The  parameter  0t  is  usually 
also  stationary,  and  the  calculations  reduce  to  updating  posterior  to 
data  mixing  probabilities  ir(a  |  x)  . 

The  strict  ordering  (2.2)  only  applies  if  there  is  a  scalar 

hyperparameter  in  the  prior,  (or  if  it  is  an  abstract  index  over  F) . 

Figure  2  shows  the  situation  if  the  hyperparameter  is  a  two-vector, 

oi  *■  (a..  ,a„  )  •  From  the  form  of  the  conditional  prior  p(0  |  a)  , 

“T  1  ,  C  L  ,  u 

we  can  in  principle  find  the  allowed  region,  R(at_^)  ,  for  such 

that  ~  9t-l  ’  as  s^own>  This  region  depends  upon  and 

includes  it;  in  other  words,  the  stochastic  ordering  of  the  parameters 
induces  a  partial  ordering  over  the  vector-valued  hyperparameters. 

The  transition  probabilities  p(a.t  |  ^)  then  provide  the  appropriate 

measure  over  R(a  .)  . 

— L“1 

We  also  see,  upon  reflection,  that  our  formulation  can  produce 
many  other  forms  of  parameter  relationships  than  (1.2)  or  (2.1), 
through  appropriate  choices  of  R  .  For  instance,  if  p(0  |  a)  is  a 


9.  APPLICATION 


In  spite  of  its  generality,  this  approach  has  serious  practical 
drawbacks.  The  first  is  that  it  is  difficult  to  construct  analytic 
models  in  which  the  hierarchical  computations  can  be  carried  out 
explicitly;  even  with  a  natural  conjugate  prior  on  9  ,  there 
remains  the  problem  of  specifying  the  hyperparameter  density  in  a 
convenient  form.  ([4]  illustrates  some  of  these  problems  using  the 
shrinkage  (1.4).) 

Secondly,  digital  computations  require  an  additional  dimension 
of  the  discretized  space,  so  that  it  is  difficult  to  approximate  the 
usual  continuous  densities.  Limited  computational  experience  with 
small,  rectangular  priors  and  hyperpriors  indicated  that  the  growth 
under  stochastic  ordering  behaves  as  expected,  with  an  occasional 
reversal  of  growth,  but  otherwise  was  not  illuminating. 

Finally,  of  course,  we  should  question  the  hypothesis  of  stochastic 
ordering  itself.  A  decision-maker  might  believe  that  improvement 
occurs  "on  the  average",  for  instance,  but  would  prefer  to  model  the 
anti-growth  situations  in  a  completely  different  way,  with,  say,  (2.1) 
replaced  by  an  ordering  of  the  means  only.  We  doubt  seriously  that 
any  real  data  could  discriminate  against  two  such  competing  models. 
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